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REAL-TIME MULTIPLE LAYER DISPLAY 

Technical Field 

This invention relates to the field of electronic information display. 
5 Background Art 

Real time operation or monitoring of many machines, vehicles and processes (hereafter called 
machines) requires the observation of a multiplicity of parameters simultaneously with viewing 
the implementation of the activity or process being carried out by the system. In some cases this 
is achieved by the use of a "head-up display" system (HUD) in which images of the most 

10 significant instrument readings are projected into the operator's view of the process at a plane 
coincident with the position of the activity by means of a partially reflecting intermediate screen 
in front of the operator through which the principal activity is viewed. The said screen needs to 
be at an angle of around 45 degrees with respect to the vertical plane. For example in a fighter 
aircraft the pilot views the region external to the aircraft through a conventional windscreen and 

15 side windows, but sees the primary instrument readings by reflection from a semi-transparent 
screen interposed between his eyes and the windscreen. The projection of the instrument readings 
via the semi-transparent screen is arranged to be "at infinity" or effectively at the same distance 
from the pilot as the external region so that no focal adaptation of the eyes is required to see the 
instrument readings. 

20 Another method of operating machines, especially remote controlled or inaccessible machines, 
requires viewing an image of the activity or process on one or more display screens. Typically 
additional screens are used to display instrument readings so that the operation of the machine 
can be monitored and controlled. In many cases it is very important that the operator is able to be 
continuously aware of the most significant instrument readings while operating the machine. 

25 

Despite its advantages, the HUD is a cumbersome system. The need for a partially reflecting 
screen at about 45 degrees to the vertical in front of the operator creates problems including 
cluttering the cockpit. The projection system takes up space that designers would prefer to use 
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for other purposes. In order to use the HUD effectively, the operator has to keep their head within 
a limited area. 



A method of displaying a view of the activity or process on a video screen placed behind another 
5 transparent video screen which displays the significant instrument readings or parameters of the 
machine and which allows the operator by moving their head to see around any displays on the 
front screen would provided all the benefits of the HUD system while avoiding the need for a 
cumbersome angled semi reflecting screen in front of the operator. When used to operate remote 
controlled or inaccessible machines, the use of a multilayer screen with the instrument readings 
10 or relevant data displayed on the transparent front screen and the activity or process displayed on 
the back screen, the benefits of a HUD display could be provided without the activity or process 
area being accessible to the operator. 

At present there exist methods to produce displays where several imaging planes are stacked with 
15 set distances between them. These imaging planes may also be stacked as closely as possible. In 
a preferred embodiment these displays consist of a high-brightened backlight, a rear image panel 
which is usually an active matrix, colour display, a diffuser and a front image plane, which are 
laminated to form a stack. There are generally colour filter stripes, and a black matrix on each 
display which defines the borders of the pixels. However it should be appreciated that the 
20 following discussion applies to all image planes that are addressed by passive or active matrices 
or have colour filters arranged in any periodic pattern. For the purposes of the present invention 
these image planes may not be addressable at all. 

It is an object of the present invention to address the foregoing problems or at least to provide the 
25 public with a useful choice. 

Further aspects and advantages of the present invention will become apparent from the ensuing 
description which is given by way of example only. 

Disclosure of Invention 

Accordingly a first aspect of the current invention comprises a display system for viewing real 
30 time images and information comprising, at least one display device to which real time 
information from sources within the line of sight of the display system is fed such that said 
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display device(s) is (are) displaying real time information from sources within the line of sight of 
the display system. 

The term 'real time information' as used herein should be interpreted to mean any information 
such as (without limitation) images, infra-red readings, ultrasound information, sounds and aural 
5 data, data relating to the operation of a machine or machine(s), temperature, GPS or any data 
about the local environment which is taking place or fed to the display device in real time. 

The term 'line of sight' as used herein should be interpreted to mean the line of sight in the 
direction that the rear of the display system is facing. Typically it is the point of view of a 
viewer, viewing the display device from in front of that display device. But may be broader than 
1 0 the line of sight of a human. 

Preferably the scope or breadth of the line of sight within which real time information is fed to 
the display device can be manipulated by a user to be narrower or broader depending on the 
user's preference. 

As such the present invention is a display device whereby the viewer is presented with 
1 5 information in relation to the current environment in which the viewer is located. 

Accordingly a further aspect of the present invention comprises a display system for viewing real 
time images and information comprising, at least one multi layer display device to which real 
time information from sources within the line of sight of the display system is being fed such that 
said multi layer display device(s) is (are) displaying real time information from sources within 
20 the line of sight of the display system. 

Preferably the multi layer display device consists of at least two display layers at least in part 
over lapping with the foreground layers being transparent or partially transparent. 

Accordingly a further aspect of the current invention comprises a display system for viewing real 
time images and information comprising, at least one display device to which real time 
25 information from sources within the line of sight of the display system is fed such that said 
display device(s) is (are) displaying real time information from sources within the line of sight of 
the display system and additional information which is related or unrelated to the real time 
information being displayed can also be displayed. 
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As such the viewer of the display system is able to have access to both real time information 
within the line of sight of the display system along with additional information which may for 
example assist and/or instruct the viewer in interpreting the real time information being displayed 
and interpreting the surrounding environment. 

5 Said additional information may be real time or non-real time information. The source of that 
information may also be from outside the line the not within the line of sight of the display 
device. 

Accordingly a further aspect of the current invention comprises a display system for viewing real 
time images and information comprising, at least one display device to which real time 
10 information from sources within the line of sight of the display system is fed such that said 
display device(s) is (are) displaying real time information from sources within the line of sight of 
the display system where said real time information can be manipulated by a user in order to 
control or assist the operation of a machine. 

Reference throughout this specification is made to the present invention as applying to video 
15 display systems However, it should be appreciated by those skilled in the art that other types of 
display and imaging systems may be used in conjunction with the invention, not necessarily 
being video screens. 

In a preferred embodiment of the present invention there is provided a method of displaying an 
activity or process occurring in real time for the benefit of one or more operators while 
20 simultaneously allowing the said operators to view instruments readings or data relevant to the 
operation of a machine providing the process or activity in the manner of a HUD wherein 

a) the activity or process is viewed by a video camera and the image displayed on the rear 
screen of a multilayer screen system containing a separate rear screen and a transparent front 
screen parallel and directly in front of the said rear screen, 

25 b) The most significant real time instrument readings or data, critical real time messages or 
other relevant information is displayed on the front transparent screen in such a manner that it 
does not significantly obscure the view of the rear screen, 

c) the front and rear screens are separated in space so that the operator can easily shift their head 
to look around displays on the front transparent screen to see details on the rear screen that 

4 
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d) data on the front screen can be manually or automatically changed or displayed in sequence 
and selected in real time for its significance so that the operator is able to get a broad and 
appropriate idea of the said parameters as the machine is operating without having to look 

5 away from the said display or look at other separate screens, 

e) where appropriate, idealised or schematic images or pictures or images or samples or models 
can be displayed on the front screen for comparison with the real time images on the rear 
screen to assist the operator in achieving the required objectives, or identifying objects 
displayed on the rear screen, and 

10 f) the camera or cameras presenting the images of the activity of process to the rear screen can 
be selected, moved, varied in focus, magnification or position as required, and can operate in 
a split screen or full screen mode as selected. 

For this invention, the basic display system may comprise two parallel coaxial video display 
screens typically separated by between 15 and 100 millimetres. The rear screen is the same size 
15 as or larger than the front screen in order to minimise the viewing effect similar to that of looking 
through a window. The front screen is transparent except where a display is produced so that the 
rear screen is normally clearly visible through the front screen. Typically a backlit liquid crystal 
display is used for the front screen with the back lighting being provided by or through the rear 
screen which is commonly but not necessarily another liquid crystal display screen. 

20 The present invention displays a real-time representation of the actions scene, activity or process 
on the rear image plane of a multilayered display. Data or instructions from sensors, instruments, 
diagrams, samples or other relevant information which relates to the machine or operator or 
operation may be overlaid upon the scene on the front image plane. For example, in an aircraft, 
the real time view from the cockpit or front may be displayed on the rear screen, while 

25 parameters such as airspeed, altitude, heading, and position and the like are displayed on the 
front screen. From time to time other relevant or urgent parameters or messages may also be 
displayed on the front screen as well as or in place of other data. Since the distance between the 
two displays is controllable at manufacture the operator will not have to spend unnecessary 
amounts of time refocusing or searching in changing their view between the two representations 
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of information thereby maintaining better situation awareness. 



Where pixel image details on the rear screen are obscured by displays on the front screen, it is 
simple for an operator to shift sideways and physically look around the front display to see the 
otherwise obscured details on the rear screen. This improves the applicability and versatility of 
5 the system in this invention. It is therefore satisfactory to display the video image of a scene, 
operation, process or activity on the rear screen while displaying data or information on the front 
screen for the benefit of the operator or viewer. By this means, data or quantitative information 
on the front screen is easily absorbed by the viewer while they can simultaneously appreciate and 
react to the view seen on the rear display. Furthermore, as both screens are viewed 
10 simultaneously, the viewer is not forced to refocus on other data sources as would be the case if 
instruments were displayed on another display system as has generally been the case. 

In many processes and activities it is useful to compare a real object or real scene with a 
schematic, model or ideal scene in order to allow an operator to interact with or control a 
machine. The system of the present invention readily allows this by typically having the real time 
15 scene displayed on the rear screen, and the schematic or idealised scene displayed in part or 
whole on the front screen of the system. 

When an operator is controlling a machine, generally relevant data can be displayed in 
succession on the front screen to allow the operator to carry out any actions reactive to this data. 
Furthermore, warning messages, instructions and other data can be displayed in front of the 
20 operator and are automatically seen by the operator so that they can be reacted to or 
implemented. This is more immediate and more certain than conventional system where the 
messages and data are displayed on separate system which can only be seen or read when the 
operator takes their eyes away from the real time scene displayed, in this invention, on the rear 
screen. 

25 In another embodiment the invention may comprise a tiled array of multilayered displays with 
one or more cameras relaying information to the rear screens as described above. By this means 
an exterior scene would be displayed on the rear image plane of the array while other relevant 
information or data is displayed on the front image plane of the said array. This again would 
allow viewers to avoid having to change focus while studying or using the display and 

30 comparing or applying information provided on the front screen to help understand or control or 
manipulate the system in respect of the processes being displayed on the said rear image plane. 
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It should also be appreciated that the cameras may be displaying a scene in a dissimilar 
geographical location to the said array. For example the array may be in United States and the 
image shown may be of the European Alps. In this form of the invention a said array may be 
used for illustrating or demonstrating attractive or eye-catching visual displays to the public on 
5 the rear screen array while providing advertising or documentary material related to the display 
on the front screen array. 

In yet another embodiment, the invention can be used for teaching, demonstrations, promotion 
advertising or the like by showing real time or recorded images on the rear screen while 
appropriate or related data, information, advice, instruction, advertising or promotion material is 
10 displayed on the front screen. The material displayed on the front screen may be displayed 
continuously or intermittently and may be varied to relate to the images being shown on the rear 
screen. Additionally, the images shown on the rear screen may be varied, controlled or selected 
by an operator or viewer according to their interests, progress or requirements. 
Brief Description of Drawings 

15 Further aspects of the present invention will become apparent from the 
following description which is given by way of example only and with reference 
to the accompanying drawings in which: 

Figure 1 is an oblique diagrammatic view of a display system in accordance 
with one embodiment of the present invention. 

20 Figure 2 is a diagrammatic side view of a display system in accordance with 
one embodiment of the present invention. 

Best Modes for Carrying out the Invention 

A preferred embodiment of the current invention is a hand held multi layer display device for the 
display of real time and other information. On the rear of this device are input sources such as a 

25 camera, an infra-red sensor, a digital thermometer, an ultrasound horn, and other input devices 
and sensors. Information from those sensors and devices is fed to a CPU or controller which in 
turn displays the information (or some of it depending on user preferences) on the layers of the 
multi layer display. In a preferred embodiment, the images from the camera are displayed on the 
rear layer of the display device with additional information such as temperature being displayed 

30 on the front display layer(s). The layer on which information is displayed is chosen by the user or 

7 
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presets information. 

In a further preferred embodiment of the current invention the display system acts as if it were a 
window on the inside of a vehicle such as a plane, tanks, or other. In this embodiment the display 
device displays the view presented to the camera which is such that the viewer can in effectively 
5 see outside the vehicle. 

Figures 1 and 2 illustrate a display system generally indicated by arrow 1. The front screen 2 is 
separated from the rear screen 3 by a block of clear acrylic material 4 which also provides mutual 
support for the two screens. Backlighting for the system is provided by a backlight 6 behind the 
rear screen 3, the backlight being shielded by the cover 5. The front screen is transparent in all 
10 regions except where a display is activated. 

In operation, a video display of a real time scene or process being taken by a video camera is 
applied to the rear screen 3. Instrument readings, which may be pictures of instruments or simply 
numbers associated with captions, diagrams, messages, data and other material are displayed by 
standard video processes on the front screen 2 as appropriate. In general displays of routine 
15 readings and data would be confined to the periphery of the front screen while urgent messages 
and important material would typically be displayed across the centre of the front screen. 
Displays on the front screen would normally have a high degree of transparency to minimise 
obscuration of the rear screen 

Aspects of the present invention have been described by way of example only and it should be 
20 appreciated that modifications and additions may be made thereto without departing from the 
scope thereof. 
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1 . A display system comprising at least one display device to which real time information from 
sources within the line of sight of the display system is being fed such that the display is 
displaying real time information from sources within the line of sight of the display system. 

5 2. A display system as described in claim 1 where at least one of said display device(s) is a 
multi layer display. 

3. A display system as described in either of claims 1 or 2 where additional related or unrelated 
information can be displayed on said at least one display device. 

4. A display system as described in any of claims 1 to 3 where said real time information can be 
1 0 manipulated by a user in order to control or assist the operation of a machine. 
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Figure 2 
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